Detecting Hands in Children's Egocentric Views to Understand Embodied Attention during Social Interaction
نویسندگان
چکیده
Understanding visual attention in children could yield insight into how the visual system develops during formative years and how children’s overt attention plays a role in development and learning. We are particularly interested in the role of hands and hand activities in children’s visual attention. We use headmounted cameras to collect egocentric video and eye gaze data of toddlers during playful social interaction with their parents, and developed a computer vision system to track and label different hands within the child’s field of view. We report detailed results on appearance frequencies and spatial distributions of parents’ and children’s hands both in the child’s field of view and as the target of the child’s attentional fixation.
منابع مشابه
Analyzing Hands to Recognize Social Interactions with a Large-scale Egocentric Hands Dataset
Hands appear very often in egocentric video, and their appearance and pose give important cues about what people are doing and what they are paying attention to. But existing work in hand detection has made strong assumptions that work well only in simple scenarios, such as with limited interaction with other people. We develop methods to locate hands and distinguish between hand-types in egoce...
متن کاملMy Hand or Yours? Markedly Different Sensitivity to Egocentric and Allocentric Views in the Hand Laterality Task
In the hand laterality task participants judge the handedness of visually presented stimuli--images of hands shown in a variety of postures and views--and indicate whether they perceive a right or left hand. The task engages kinaesthetic and sensorimotor processes and is considered a standard example of motor imagery. However, in this study we find that while motor imagery holds across egocentr...
متن کاملTracking Hands of Interacting People in Egocentric Video
Wearable cameras are becoming practical and inexpensive, creating new applications and opportunities including novel studies of social interaction and human development. Recent work has focused on identifying the camera wearer’s hands in egocentric video, as a first step towards more complex analysis. Here we study how to disambiguate and track not only the observer’s hands but also those of so...
متن کاملDetecting Hands in Egocentric Videos: Towards Action Recognition
Recently, there has been a growing interest in analyzing human daily activities from data collected by wearable cameras. Since the hands are involved in a vast set of daily tasks, detecting hands in egocentric images is an important step towards the recognition of a variety of egocentric actions. However, besides extreme illumination changes in egocentric images, hand detection is not a trivial...
متن کاملEgocentric Pose Recognition in Four Lines of Code
We tackle the problem of estimating the 3D pose of an individual’s upper limbs (arms+hands) from a chest mounted depth-camera. Importantly, we consider pose estimation during everyday interactions with objects. Past work shows that strong pose+viewpoint priors and depth-based features are crucial for robust performance. In egocentric views, hands and arms are observable within a well defined vo...
متن کامل